Early Cloud Experiences with the Kepler Scientific Workflow System
نویسندگان
چکیده
With the increasing popularity of the Cloud computing, there are more and more requirements for scientific workflows to utilize Cloud resources. In this paper, we present our preliminary work and experiences on enabling the interaction between the Kepler scientific workflow system and the Amazon Elastic Compute Cloud (EC2). A set of EC2 actors and Kepler Amazon Machine Images are introduced with the discussion on their different usage modes. Through two bioinformatics usecases, we demonstrate the capability of our work for both Cloud resource coordination and workflow execution on virtual Cloud resources.
منابع مشابه
Transparent Access to Scientific and Commercial Clouds from the Kepler Workflow Engine
This paper describes the architecture for transparently using several di erent Cloud Resources from with the graphical Kepler Worklfow environment. This architecture was proven to work by implementing and using it in practice within the FP7 project EUFORIA. The clouds supported are the Open Source cloud environment OpenNEbula (ONE) and the commercial Amazon Elastic Compute Cloud (EC2). Subseque...
متن کاملA Clustering Approach to Scientific Workflow Scheduling on the Cloud with Deadline and Cost Constraints
One of the main features of High Throughput Computing systems is the availability of high power processing resources. Cloud Computing systems can offer these features through concepts like Pay-Per-Use and Quality of Service (QoS) over the Internet. Many applications in Cloud computing are represented by workflows. Quality of Service is one of the most important challenges in the context of sche...
متن کاملKurator: A Kepler Package for Data Curation Workflows
Data curation is critical for scientific data digitization, sharing, integration, and use. This paper presents Kurator, a software package for automating data curation pipelines in the Kepler scientific workflow system. Several curation tools and services are integrated into this package as actors to enable construction of workflows to perform and document various data curation tasks. The integ...
متن کاملDeploying Kepler Workflows as Services on a Cloud Infrastructure for Smart Manufacturing
21st Century Smart Manufacturing (SM) is manufacturing in which all information is available when it is needed, where it is needed, and in the form it is most useful [1,2] to drive optimal actions and responses. The 21st Century SM enterprise is data driven, knowledge enabled, and model rich with visibility across the enterprise (internal and external) such that all operating actions are determ...
متن کاملApproaches to Distributed Execution of Scientific Workflows in Kepler
The Kepler scientific workflow system enables creation, execution and sharing of workflows across a broad range of scientific and engineering disciplines while also facilitating remote and distributed execution of workflows. In this paper, we present and compare different approaches to distributed execution of workflows using the Kepler environment, including a distributed dataparallel framewor...
متن کامل